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A multi-windowing technique tor threshholding an image using local ima 9 e properties 



(54) 

(57> A technique, specHicaly apparatus and an 
accompanying method, tor accurately, thresholding an 
image based on local image properties, specifically lumi- 
nance variations, and particularly such a technique that 
uses multi-windowing tor providing enhanced immunity 
to image noise and lessened boundary artifacts. Specrt- 
cally a localized intensity gradient. G(ij). is determined 
for a pre-defined window (300) centered about each 
imaoe pixel(i j). Localized minimum and maximum pixel 
Sty meatres. and L_. respectively are also 
determined tor another, though larger, window (330) cen- 
tered about pixel(ij). Also, a localized area gradient 
measure. GS(ij). * determined as a sum of »nd.vjua 
Sty gradients for a matrix of pixel posit.ons (370) 
3 about pixel position (i j). Each image p.xel(i.D is 
then classified as being an object pixel, i.e.. black, or a 
background pixel, i.e.. white, based upon as area gradi- 
ent GS(ij). and associated L^ and L^* measures. 
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Description 

TPr.HNIP.Al FIF 1 D ™ TMg INVENTION 

The invention relates to a technique, specifically apparatus and an accompanying method, lor accurately thresh^ 
olding an image based on local image properties, specifically luminance variations, and particularly one that uses mutti- 
windowing tor providing enhanced immunity to image noise and lessened boundary artifacts. 

RAr.KfiROUND ART 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
ot printed or other textual documents are being scanned tor subsequent computerized processing ol one form or another 
and/or dinital transmission. This processing may involve, tor example, optical character recognition, tor converting printed 
characters whether machine printed or handwritten, from scanned bit-mapped torm into an appropriate character set. 
such as ASCII, the latter being more suitable tor use with word processing and similar computerized document-process- 
ing fcjf^ a gray-scale document typically yields a multi-bit. typically eight-bit. value fa each pixel in the scanned 
document The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
in the document These pixels are generated, depending upon the resolution of the scanner, frequently at resolutions 
of 200 4O0 pixels/inch (approximately 80-1 60 pixels/cm), though with highly detailed images at upwards of 1200 or more 
Dixete/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 11 inch (approximately 22 by 28 cm) image 
will contain a Considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
characters of some sort against a contrasting colored background, typically white or black print against a white or light 
colored background or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
thai nixel is either part of a character or the background. Therefore, scanned textual images, or scanned textual portions 
of lamer images containing both text and graphics, can be efficiently represented by single-bH pixels in which each pixel 
in a scanned image is simply set to. e.g.. a "one' if that pixel in the original image is part of a character or part of 
toreoround information, or to. e.o.. a "zero" if lhal pixel in the original image is part of the image background. To easily 
rftetinouish the different types of scanned images, a gray-level image is defined as one having multi-bit (hence muM- 
valuel oixels whereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen-, 
erate considerably less data for a given textual image, such as. e.g.. one-eighth, as much as for an eight-bit gray-scale 
rendering of the same image, binary images are more efficient over conesponding gray-scaleimages and thus P'elened 
torstorage and communication of textual images. Binary images are also preferred because of their easy compressibility 
. i<;ino standard corroression techniques, e.g.. CCITT Groups 3 or 4 .compression standards. 

Grav scale images are converted to binary images through a so-called thresholding process. In essence/each mutt- 
hh ni«,i value in a oray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variable 
or even adaptive* variable, to yield a single corresponding output bit. If the multi-bit pixel value equals or exceeds the 
threshold value for that particular pixel, the resultant single-bH output pixel is set to a "one": otherwise if the threshold is 
oreater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
Ltracts those pixels such as those which torm characters, or other desired objects, from the background in a scanned 
orav scale imaoe with the pixels that form each character, or object, being one value, typically that tor black, and the 
Pixels for the background all being another value, typically thai tor white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an "object". 

Ideally the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned image and maps those pixels to a common single-bit value, such as. e.g.. "one" for black. In practice, noise, 
backoround shading lighting non-uniformities in a scanning process and other such phenomena, preclude the use of a 
sinole fixed threshold for an entire image. In that regard. H the threshold is too low. the resulting image may contain an 
excessive amount of noise in certain, if not all regions; or. if too high, insufficient image detail, again in certain. H not all. 
reoions - thereby complicating the subsequent processing ot this image. Given this, the art recognizes that a preferred 
aDoroach would be to select a different threshold value thai is appropriate to each and every pixel in the scanned image, 
indoino so the proper threshold value is determined based upon local properties of the image, i.e.. certain image 
characteristics that occur in a localized image region tor that pixel. Hence, the threshold would vary across the image, 
oossiblv even adapt to changing localized image conditions. 

In oeneral a common methodology for variable thresholding relies on measuring localized image characteristics, 
such as local intensity contrast (or gradient), local averaged intensity anoVor local variance, in a local window centered 
about a pixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
oround pixels white. Here. too. reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated bv a need to extrad various objects in a wide range of documents but with minimal user intervention, such 
as for purposes of initialization and object identification, and while still yielding a clean background in the thresholded 



2 



EP 0 712 094 A2 



10 



15 



►, iec ts mav include e.g.. dim. broken objects; and objects that present a relatively low contrast. 

image.lnrea,^ 

such as white objects in a gray DacKg rou . a j > d adequale performance with actual 

Nevertheless, given the overwhe^ng ^J^fJ^^^^ thaTattempt to provide satisfactory 
ima9 es.thea r spersis^ 

periormance. However, all these approac * localized image properties, are taught in M. Kamel et 

Various aPP^ches ^ed u^^^ 
a... "Extraction of ^£^5^%%* 203-217. Here, a 'logical lever approach is based on co^ge 
lman » Processing. Vol. 5 f ' ^ 3 :^ h ^„r:L e , (H the image is noisy) with tour local averages m neighborhoods 
gray level ol a given pixel or its smoothed gray lever ■ i w iimage w sufficiently below 

Sered about tour pixels orthogonally 5U ™?'^^ "r^k-based subtraction', relies 

all tour .oca. averages, then the ^ F «* 01061 *' 

on considering every pixel « «"J£!I a ^J^S^Si ostensibly tunctioning to remove "particle- noise. The 

tne background pixets are cSS^ 1« » ines P assin9 th,0Uflh +2g* ^ TZ 

liner is applied to icvrpixelsequencestnat^es^ a character/graphics pixels which are black and 

ol 0. n/4. n/2 and 3n/4. The Moulting Uttered ^ a J , fe ^.ed ^ detecting additional back- 
background pixels which are whrte J*"?*^ "T* Ve^y poJiWe character/graphics pixel, the gray level 
ground pixels using a P^^™^ Ustty. a gray-scale cnarac4er/graph- 

ot its background image .s ^^.^^^^SSid imVge from the original scanned image wHh resulting 
ios image fe obtained *^ image. Though the global threshold 

*> diHerences then being globally ^™**y£U^^^ *^ ^ 8 background value essentially 

value itseH is fixed, basing SSuXSese two approaches would appear to be somewhat immune 

e°xt«rtng dim and/or broken ^^^^tl'Jatent 4 868.670 (issued to R.R.A. Morton et al on September 
Another approach, as described ,n 8 Zb background value in an image, with a threshold 

,9. 1989 and owned by the ^^^^'^^^Z^adK signal Here, whenever a transition 
value being a sum of a *^^^j£S; £££ momentarily varied in a predefined pattern to momentariy 
occurs in the image, such as an edge, the ,e ^ a J*^ al *^^h 0 lded pixel value has a reduced noise content, 
notify the threshold value such that ostensibly ^^^^^J^ transitions due to abrupt changes 

^fitat^ 

Here, adaptive thiesholdir* -^.emented This offset potential is u sed to conjunction 

basis as a function of whrte.peak and W^aney PJT^ . tha1 ^ ries pixel-by-pixel. The peak and valley poterv 
wrth nearest neighbor pixels to provrie an ^MdM»U £ue . *• va ny P rjj ^ min5mum 

extracting low contrast ^^^T^Tx^^e specifically apparatus and an accompanying method, tor accu- 
Theretore. a need ex.sts in the art for a .^^^^^ J£ . ^ a threshold that varies based on local 
rately and relief th.es SmTnity an?reduced bourxtary arfffacts as we« es 

p !££ ! r.Q. irp OF THEJNV^NIJQN 

„ .l,. jrfiripncies in the art through our inventive mufti- window 

We have substantially and advantageously overcome the deficiencies in tne an i ug 

thresholding technique. . .. , in1enEitv aradient G(i j). is determined for each pixelfij) in an incoming 

Specifically, through oor ^ e .:^;^ a window, illustratively 3-by-3. of pixels centered 

scanned gray-scale bit-mapped .mage. This gradient »^ detected for an N-by-N pixel window 

a£>u» pixel(ij). Next, minimum intensity. J-^"^^^^^ being a sum of individual intensity 
centered over the image about p.xel( j) In addrt on a a«»oa _ V' ^ nion f|J) . 

gradients, is ascertained '<» a J^'* <^ pixel, i.e.. white, primarily based 

°Each pixelOJ) is then dass red as J^^^SS^ £„, values. These three parameters are 

upon its area gradient GS(.j). and ^conda ^^"^ h jxe|bei centeted in various windows, one tor determining 
determined*, ^J^^^^^SXSi associated and U», values. Once the gradient 
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. .cino these local measures, each image pixeKlj) is f irst classified as being near an edge or not. In regard each 
• ^ TZ^sZ Classified if the local measures the.efor. specifically its associated area gradient, exceeds a 
Pa HZ TJr HhSLoS value aherwise. that pixel is viewed as falling within a locally flat field, i.e.. of relatrvely constant 
******* ScSlv edge P«els are classified by comparing their intensity values against average .ntensrty values 
SmocsT TpS wSr^vs therefor ; in contrast, pixels in flat f ields are classified by comparing the, .ntensrty aga«st 

a »»^^ ^(i j) locate in a vicinity of an edge in the image is detected whenever the area gradient. 

lnpart,cular an .rnageP'^'J)'^ ~ lSJQ J^ an a predefined gradient threshold. GT. Once such a pixel is 

found, ^ch p«er on a dam * ^ ^ ^ fe ^ an average of rts 

7. p.xel wmdow *^ rt '~ |ues Alternatively, f. the intensity of this latter pixel, k. exceeds the average .ntensrty value 
assoaated L,™ a "^ x particular pixel is classrfied as being background. i.e.. white. 

of L™ and U„. men anus p k threshold, such as where the N*y-N window 

. . ^^ST^S^^'^ 9-y-sca.e. p«e.(i j) is classic by simple trvesttolding J.e, thjesh- 
S S H^r'c^e va S against a constant predefined threshold value. IT. Here, if the gray-sca e value o1 P .xel(,j)* 
£Ti£ SeCshoW value IT. this pixel is dassHied as an object P *el. Le.. black; otherwise. thrs p,xel .s des,gnated 

85 T d ^So^getaX%oi^ so further increase th, eshoWing accuracy, the intensity values of those pixels 
e 1£?! l 7Z£S% For the preferred embodiment, black pixels are illustratively represented by a value of zero 

^^ZZ2* the threshold value. IT. the intensity of each of these pixete is reduced to a value shghtty below 
£ hSd itTo^o a value IT- In contrast, the intensity values for those pixete. located on a bnghter s.de of an edge 
th "^ In J ^S^srt va^ue less than threshold value IT. are increased to an intensity value slightly ^reaterthanthresn- 
o^uTfT e^o 2"e A hfch quality binary image can then be produced by merely thresholds the resutbng 

grayscale image SareTrsummJintensity) gradients, the present invention significantly reduces 

J^SSSi e^^Z^^o, while accurately extracting objects in a threshold irnagejlte 

o^Srtrast objects and thus readily produces a high quality binary image, 
nRirF PF c^. P T.ON OF THE DRAWINGS 

The teachings of the present invention may be readily understood by considering the following detailed description 
in conjunction with the accompanying drawings, in wh.ch: 

FK3.1depictsahigh-level block diagramof document irr^ging system 5 that embodies the teachings of our present 

invention; 

FIG. 2 depicts the correct alignment of the drawing sheets for FIGs. 2A and 2B; 

FK3S. 2A and 2B collectively depict a high-level flowchart of our inventive mufti-windowing thresholding method; 

FIG 3A depicts a 3-by-3 matrix of pixel location def initions which we use in determining, through a "Sober gradient 
operator, gradient strength for current pixel(ij); 

FIG. 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a cunent pixelO j) 
in an image intensity record: 

FIG acdcpiasagraphicalrepresertationo 
(ij) in an image intensity gradient record; 

FIG 4 graphically depicts intensity profile 400 of an illustrative scan line of an original gray-scale image, such as 
that illustratively on document 1 0 shown in FIG. 1 : 

FIG 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
FIG! 4 according to the teachings of our present invention; 

FIG. 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG. 7 depicts a block diagram ol Sum of Gradients Circuit 620 which torms part of circuit 600 shown in FIG. 6; and 

FIG 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also torms part of circuit 600 
shown in FIG. 6. 

To facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various figures. 

MQDEg OF QABBSIMS 01 T THE INVENTION 

Atter reading the following description, those skilled in the art will quickly realize that our invention Is applicable tor 
use C. neariy an? document imaging system for accurately thresholding scanned documentary .mages ccrtaininghne 
»n r^ih reoardtoss of what that line art contains and the media upon which the image carnally appear*. For example. 
J' ,S art £ukiS graphs, maps, characters and/or line (skeletal) drawings. Nevertheless tor mepurpcse of slnpllfy.ng 
me SSSSS^ -e waidiscuss our invention in the context of use in thre^ scanned character data, such 
lc ,«*«■ inters and numbers, which we will collectively refer to hereinafter as objects . 

^pu poTes oT lustration and discussion, we define black and while gray-scale pixels ^vir^«0N^gray- 
. IZS-rr and "255- respectively. For consistency, we also define output binary pixels wrth black being "O; and 

2eb^^ 

mequ^es that compare pixel intensHies. as would be readily apparent to those skilled in the art. reversed from those 

6h °^G td^plct^igh-leve. block diagram of document imaging system 5 that embodies the teachings of our present 
™t Arfhown system 5 is formed of gray-scale scanner 20. digital image processor 30 and "simple* thresholding 
to oS^n document 1 0 contaL!g various objects of interest is scanned by scanner 20 to produce muW- 
b^S. y e°gh SrW-rna^ gray-sca.e image data. L This data is routed, via leads 25. to a data input of digjtel 
ITTo^sso? which in turnand to the extent relevant here, thresholds the scanned image data and generates both 

leads 37 and an output binary image on leads 33. The modified 0 ray-sca.eima 0 e. as 
I mC ^-,f n[ J,er detail below, has its edges enhanced by processor 30 to subsequently increase thresholding accu- 
deS °£?mcSXJ ToS sca^ in^ge data^aring on leads 37 fe routed to an input of thresholding circuit 40 whlch- 
c^i^ -W bit ^age pixel in the^odrf-ed image data against a pre-dettoed fb«ed freehold vatoe thereby 
^If^led^simple- thresholding. The resulting thresholded. i.e.. binary, image produced by circuit 40 is applied. 
Steads 4? a ^ SotoeToutout binary image. Digital image processor 30 performs thresholding in accordance wrth our 
^tnttmio^ To handiehigh data throughputs required tor processing bit-mapped .mages, processor 30 is prefer- 
^SSedTor^ ^de^cated hardware circu£* induding our inventive circuH 600 shown in FIG. 6 and discussed in 
ll-^M^Z^V. this processor can be implemented through one or more general purpose miaoprocessors. 
S iSSateS memory and supporting drcuitry and suitably programmed to implement our ipresent invention in 
^e^SZTS* f mcroplocessa(s) could execute instructions sufficiently fast to produce the requisite data 

throughput. ^ muttj . wjndowing thf€Sho , d ing method 200 is collectively depicted in FIGs. 2A 

and J B tor wSh U^correcl alignment of the drawing sheets tor these f .gures te shown in FK3. 2. Dunng the course ol 
lifcriis&ina method 200. reference will also be made to FIGs. 3A-3C wheie appropriate. 

Me KoS performed for each and every grayscale pixe. rn an incoming image thereby rteratir^through »e 
,n«o?Snce the manner through which each gray-scale image pixel is processed is ident-cal across a» such pixels, we 
lESSSE^!* routine in the context ol processing generalized pixe.(i.j). wherei and j are posrtrve integer, > and 
I inTLxel horizontal and vertical indices within the incoming gray-scale image. In add-on *° 9ray-scale .mage date. 
ftT s^ieTvalues of two input parameters. specifically fixed thresholds IT and GT These thresholds are adjusted. 

bell eHher to provide satisfactory thresholding across a multitude ol differing .mages with varying char- 
as^c^sf a'nd illumination, or can be adjusted to provde optimum thresholding for any one type of 
r^ofa^orscanning condition. In any event as a resuh ol performing method 200 on all such gray-scale ^gepocete. 
S£d Srv o^ modHied gray-scale image will be generated. wHh each pixel in the resulting image corresponding 

k ♦ C1p L m^hresholdeo in a "simple- fashion using a fixed, pre-defined threshold, hav.ng a value IT. as that value 
S b r ^ image can then be further processed. e.g.. through scaling or filtering, as 



£5 



foarticular upon starting method 200. step 203 is first performed. This step determines a gradient strengthfor 
• 5n "SS is accomplished I by use of the so-called "Sobe!" gradient operator on a wmdow ol pixels centered about 
SSn MshowntoFlG.3A. this matrix, shown as matrix 300. is a 3-by-3 window centered about pixe.(i J). ^ cd.ect.vefy 
in^ua^i (1)-<3) below, the Sobel operator relies on computing horizontal and vertical p.xel .ntensrty grad.ents. 
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GX(i.D and GYfi.j). respectively, and tor each pixel position fij) forming the gradient strength. G(ij) as an absolute sum 
of GX(ij) and GY(i j): 

GX(i.j) = Lfi+1j-1) + 2L(k1jVL(i+lM (1) 
GY(ij) = L(i-1j+1)4 2L(ij+1) + Lfi+^^ (2) 
G(ij) = |GX(ij)MGY(i.j)| *. " (3). 

where: G(i.D is the gradient strength at pixel position 
(> j): and 

L(i j) is the image intensity, luminance, at pixel 
The reSuiggladient strength value tor every image pixel collectively forms a gradient strength record tor the entire 

808 Once ^gradient strength. G(ij). is determined tor pxel(ij). method 200 advances to step 2W. TOs^when 
n^orm«l determines the area gradient for pixel position f, j). i.e. GS(U), as the sum of the grad.ent strengths for each 
aS e^v Pixel position within an (N-2)-by-(N-2) window centered about pixel position (i j). This window is .llustretvely 
5 JvtSete in size and is shown, as window 370. in FIG. 3Ctor an N-by-N. illustratively 7-by-7. w.ndow shown ,n FIG 
?B the latter being window 330. centered about pixel(ij). For purposes of comparison, the periphery ol an N-by-N 
k shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
^medaVeTentiaMy the same time, as svrrtolbed by dashed line 244. as is s^ 

P ^Z^ *£ ™»™ m pixel intensity va.ues. and L_. respectively, in an N-by-N window centered about 

Pi * e oL> the area gradient is determined tor pixel position (ij). then, through the remainder of method 200. the three 
irrage Measures. GSM and and L^,. associated with this particular pixel position are used to classify pixelf. j) 
=.c an nhipct Dixel ie Mack, or a background pixel. i.e.. white. 

in Macular decfeion step 208 is performed to assess whether the value of the area gradient for pixelfi j). i.e.. GSfi j). 
PY J2r" nre^'efined threshold value. GT. or not. This test determines whether pixelfi j) lies in a vicinity of an edge n 
Z Scanned fmaoe or not. If the area gradient is less lhan the threshold value. GT. then pixel(ij) does not he near an 
ZtatM TxelO D lies within a localized relatively constant tone. i.e.. Hat" field, region of the scanned STeyscate 
ZSL In^nt case method 200 advances along NO path 21 1 emanating from decision block 208 to deos.onblock 215^ 
^ fatter decision' block determines whether the gray-scale intensity of pixel(ij). i.e.. exceeds another pre-defined 
♦hVeVhold value IT If this gray-scale value is less than the threshold, the pixel is classified as an object P^U-e.. here 
blaS othenSe the pixeTis classified as a background pixel. i.e.. here white. Specifically, on the one hand, rl ^pixel 
frSsi^ ^ less than or equal to threshold IT. decision block 215 advances method 200. along NO path 217. to 
Vision bio* 222 This latter decision block determines whether a user has previously instructed the metnodto produce 
» Wn^or wav-scale output pixel. If a binary pixel is desired, then decision block 222 advances the method. v»a YES 
to Wock 228 which, in turn, sets an intensity of output pixel(i.j) to black, i.e.. zero. Alternatively, if a grayscale 
Soufte des^eTthen decision block 222 advances method 200. via NO path 224. to bloc* 230. This latter bio*, when 
SofmJ seShelntensrty of output pixel(i j) to the intensity ol without any modifications made thereto. If, on the 

oteltotenX k decteion 215 2 °°' "° nB ^ P-h * 

a WnTry" orTay-scale output pixel. If a binary pixel to desired, then decision block 232 advances the method, via YES 
Lft MS to block 237 which, in turn, sets an intensity of output pixel(i.D to white, i.e.. one. Alternatively, if a gray-scale 
^tLlfe de**T then decision block 232 advances method 200. via NO path 234. to block 241 . This latter block, when 
£££dWt» intensity of output pixel(i j) to the intensity of L,. without any modifications made thereto. Once step 
STaT? « 241 is periormed. method 200 is completed tor P ixel(i j); the method is then repeated tor the next image 

^S^HSSt ™* ~ad!ent. GS(i.j) exceeds the threshold value. GT. then pixe.(i j) lies in the vicinity of an edge, 
in th^e step 245 is now performed to ascertain the values of L™, and U in . H these values have not already been 
LTrrinL' asTet forth above. Thereafter, method 200 advances to block 248 which calculates an averagepixel intensity 
value™ occurring within the N-by-N pixel window centered about pixel position (i j). This average intensity value e 

cimoiv determined by averaging the values Lm, and La*,. , _ . 

Once thte averaoe value has been ascertained, method 200 advances to decision block 251 which compares tte 
intend of oixelfi i) Ie.. k. aoainst rts associated average intensity value. L^. When this pixel is situated on a darker 
SeTan edge and hence an object pixel, then its associated average intenshy value will be greater than or equal to 
^ntensHv value U In this case, the output binary pixel fa pixel position (i j) will be set to black. Otherwise if p.xel(. j) 
s sSednear anlioe but its average intensity value. L 8V9 . would be less than its intenshy value, then this pixel is 
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L then decision block 251 advances method 200. along NU patn ^ «, gray-scale output pixel. If a 

tts whether a user has p£og nS^^ES S 26B In turn, 

binary pixel is desired, then *»m ** 260 ^vanc« the ^ fe desiredi tnen deci6ion btock 260 

sets an intensity -^W to ^*S SSS m^^Twhen pertormed. determines whether 
advances method 200. via NO path 262J0 deepen woe* */u. than or equal to threshold 

pixel intensity. U. exceeds the P'^^^f J^^J3?^ P «JU sets the grayscale output lor 
St, then method 200 advances a long NO ^^^SJJJ exceeds the value oi threshold IT, then method 
SE^IS^^^ 2 ^:rhS whe P n eliuted. sets the grayscale output lor pixelQJ) to a 

value a that is sKghtly less. I*, IT-. ^ n *"^ W J^ . associated average intensity value. L^. thendedsion block 
Mernatively.^ 

251 advances method 2 0°. a tong £ES • pam gray-scale output pixel. H a binary pixel e desired, 

a user has previously instructed the ™ X ^ 0 **™**™£ to block 285 which, in turn, sets an intensity erf output 
then decision block 280 advances »• mrihod^ va JESpath 282 tottocK ^ 28Q advance s method 200. 

pixel(ij) to white. i.e ^ffiSSE^S^ N intensHy. ^ is le« 

via NOpath284. to decis on block 290 This J ^ „ fe , to threshold FT. then method 200 

than pre-detined threshed value ^j.^* len executed, sets the grayscale output lor plxe.(i j) to the pixel 
advances, along NO path 292, to btoc*295. wh«h n ^ e n method 200 advances; along YES path 

intensity value U- Now H tart^ J- ^ £££ pMU * • value that is slightly larger. i.e.. IT*. 
« 294. to block 297. wh,ch. when exearfed^ete JW"^ J tnan . respectively, threshold IT is not crHical 
^llSKaMl has been pertormed tor pixelfj); method 200 is 

men repeated lor the next ^.^^^J^^^ny depicts intensity profile 400 of an illustrative scan 
With this understanding in mind. ^^J^*™^*^J% l0 shown in FIG. 1 . As a result erf processing 
» line of an original grayscale "^^JJX JESSKw* in FIG. 5. results. As is readily apparent 
profile 400 through our inventrve method Ces the mage pixels located near an edge are modified, 

fromcomparing profles400 ^J^^^^^^^ and w^ile its intensHy is larger than threshold 
In this regard, when such a p,xe I « too* lm a ^ S J%^ 8 W| ^ ss than ^eshoW IT. Alternatively, when an image 
value IT. the intensity of th.s p.xel ^^^J^^^J^ , ess than threshold IT; the intensHy of this pixel is 

modrlied gray-scale image against ^fJ^^^^ eftt)(xSimenl specifically circuit 600. ol our present invention. 

FlGSdepictsaf^diagramof 8 ^ ^^^^ovm i FK3. 1. Clearly, image processor 30 would 
TOS ^T^ST^^^ other image processing functions; however, all that circurtry 

As shown, circuit 600 is formed of line deteys 610. " " e 65Q ^ 655; 7^.7 Max and Min detector 635; 
gradient detector 615; sum ^^^^tj^^^i inverted 664. and gates 662. 670 and 
averaging circuit 640; multiplexors 680 and ™ rf^S^ Tn FlGs 2A and 2B and discussed in detail above. 

« 675. Circuit 600 collectively ^^^^J^^o^in^ via leads 605 and 608. to an input erf 
In operation, eight-bit input 9^^^P^^^^ 610> specifically series-connected single 
„ne delays 610 and to in fcjp-t of 7^-7 Max and %£%^^£J- < £ k centered around image pixeKij). 
line delay elements 610,. 610 Z and 6IO3. p ov.de a 3-by 3^™" 9 J ne o1 the window . ^ outpu , 6 of all three 
Each delay element is tapped at three f^J^^^^Z^ 5 which, through calculation of the Sobe. 

so delay elements are routed to respecUve inputs ot gradient ™ c » leads 617 

operator, as described above, proves an M*g*d e* va. ^J?*™'^"^ gra Xnt intensity values 
gTadientva.ueisapp.^ m a6 an area gradient value, i.e.. 

in a S-by-5 window centered +** I P«e gjj^ 1 ^ 7 and disaissed in detail below. This area gradient value 
GS(i.D. on ^.«»*J5*SS JESSSL. this value against predefined gradient threshoU. GT; 

5s is applied to an input ( A ) d ' «™5^Jr ™ samecomparator. The resulting comparison output, appearing on 
the latter being applied to another inpU ^^^ni^ofTn edge or not. The comparison output is applied as an 

'"■Tol;^ 690 - as discussed ln detan the appropriate 

SSSSSf S?U or one of the predefined values IT- or IT*. 
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Max and Miri detector 635. depicted in FIG. 8 and discussed in detail below, ascertains the maximum and minimum 
pixel intensity values, i.e.. and L^, of those pixels contained whhin a 7-by-7 window centered abort pixelfij). . 
Resulting L^* and values, appearing on leads 637 and 639. are then averaged by averaging circuit 640. This droit 
contains summer 642. which merely adds these two values together into a resultant sum, and 12 and delay circuit 646 
which implements a divide by two operation by shifting the sum one-bit to the right; hence dropping the least significant 
bit. The resultant averaged intensity value is then appropriately delayed within circuit 646 tor purposes ol achieving 
proper synchronization within circuit 600. 

If the area gradient value. 6S(i j), exceeds the pre-defined gradient threshold. GT, then the averaged intensity value, 
L used as a threshold level in determining the value of output center pixel(i j); else, if the area gradient value is less 
than or equal to the gradient threshold, then value IT is used as the threshold level in determining the value of output 
center pixel(tj) In this regard, the averaged intensity value, L evg , is applied to one input of comparator 650. The current 
center pixel value, U, is applied through delay element 630 to another input of comparator 650 as well as to one input 
of comparator 655. The delay of element 630 is set to assure that the proper corresponding values of U and are 
synchronously applied to collectively comparators 650 and 655. multiplexors 680 and 690, and gating circuit 660. The 
fixed threshold value. IT, is applied to another input of comparator 655. Comparator 650 produces a low or high or low 
level output on lead 653 if pixel intensity value Cc is less than, or equal to or greater than, respectively, its associated 
averaged intensity value. Uvg- ™* °^P^ level is aPP"ed to both one input CH of multiplexor 680 and one input of 
AND gate 662. Multiplexor 680 selects the output binary pixel as between two bits generated from using two different 
thresholds i e., value IT or L avg . In that regard, comparator 655 produces a high output level at Hs A>B output whenever 
the predefined threshold value IT is greater than pixel intensity value 1^. The level at output A>B is routed, via leads 
657 to another irput CO") of multiplexor 680 and to one input of AND gate 670. Multiplexor 680 produces the output 
binary value for pixelfij). To do so. the comparison output level produced by comparator 625. indicative of whether the 
area gradient, GS(i.j). exceeds the gradient threshold, GT, is applied as a select signal, via lead 628. to a select f S") 
irout of multiplexor 680. If this select signal is high, thereby indicating that the area gradient exceeds the gradient thresh- 
old then multiplexor 680 routes the level applied to its "1 " input, i.e.. that generated by comparator 650. to binary output 
lead 33- else, the multiplexor routes the level then appearing Bt its "0" input to lead 33. 

Multiplexor 690 routes the center pixel value. 1^. or a pre-defined value IT+ or IT- as the output gray-scale value to 
eight-bit output leads 37. Pre-defined values IT+ and IT- along with center pixel value U are applied to different cone- 
SDondina eight-bit inputs to multiplexor 690. The output of this multiplexor is determined by the state of two select signals, 
SOand SV if these signals assume the binary values zero. "1" or "3*. then the multiplexor will route center pixel value 
U value IT+ or value IT-, respectively, to output leads 37. Gating circuit 660, in response to the comparison output 
sionals produced by comparators 625. 650 and 655 generates, by simple combinatorial logic, the two select signals, SO 
and Si applied to multiplexor 690. Specifically, rf the area gradient is not larger than the gradient threshold, then, as 
discussed above, gray-scale pxel value Lc, without any modification, will be applied through multiplexor 690, to output 
leads 37 Alternatively, if the area gradient exceeds the gradient threshold, then multiplexor 690 will apply ether value 
IT+ or IT- as a modified gray-scale output value to lead 37 based upon whether center pixel intensity value Uc is less 
than its corresponding average pixel intensity value, L^, or not. Since the operation of gating circuit 660 is serf-evident 
from the above description to anyone skilled in the art, it will not be discussed in any further detail. Values IT- and IT+ 
are merely held in appropriate registers (not shown) and from there applied to corresponding inputs of multiplexor 690. 

FIG 7 depicts a block diagram of Sum of Gradients Circuit 620 which forms part of circuit 600 shown in FIG. 6. 
Circuit 620 as shown in FIG. 7, is formed of adder 710 and line delays 720. the latter containing four series-connected 
single-line delay elements 720 0 , 720 1t 720 2 and 720 3 . Incoming gradient intensity values are applied, over lead 617 
from gradient detection circuit 615 (shown in FIG. 6), to one input of adder 710, shown in FIG. 7. In addition, the output 
of each of the four line delays 720 is routed over a different one of four feedback leads 715 to a different corresponding 
input of this adder. As a result adder 710 forms partial sums of 1-by-5 gradient values which are applied, as input, to 
delay element 720r> To generate a 5-by-5 sum of the intensity gradients, hence producing en area gradient measure, 
four preceding conesponding 1-by-5 sums are added together within adder 710 to a present 1-by-5 sum. with the result- 
ant overall 5-by-5 sum being applied to output lead 622. Use of these delay elements connected in this fashion substan- 
tially reduces the amount of logic that would otherwise be needed to generate twenty-five intermediate sums. 

FIG 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. As noted above, detector 635 determines the maximum and minimum pixel intensity values, L^, and 
U, respectively, within a 7-by-7 window centered about pixel position^ j). This detector is formed of two separate 
circuits- maximum detecting circuit 805 and minimum detecting circuit 840 which extract a pixel value having a maximum 
and minimum intensity value, respectively, of all the pixels contained within the 7-by-7 window centered around pixelfij) 
and respectively apply those two values to leads 637 and 639. Circuit 805 contains maximum detector 810 and line 
delays 820. the latter being formed of six series-connected single-line delay elements 820 0 , 820 1t 820 2 . 820s, 820 4 and 
820 Similarly circuit 840 contains minimum detector 850 and line delays 860. the latter being formed of six series- 
connected single-line delay elements 860 0 . 860 1( 860 2i 860 3 . 860 4 and 860 6 . Inasmuch as circuits 805 and 840 function 
is an identical manner with the exception that detector 81 0 locates maximum values while detector 850 locates a minimum 
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, « from the same series of pixel intensity values applied over lead 608. we will only discuss circuit 805 in detail; 
I " m n *J e^Z then reader appreciate how circuit 840 functions from this discussion, 
those skilled in the art wiinnen rea y ^ to one input of maximum detector 810. In addition, the 

ouput of each of the «o< ^™ a j^£ „„ ^ ma>imum pii,el Hem* value torn . 1*y7 eerie, ol P*el 
' ^\222?2 rnaSZ. «tu!te inpu. to h. delay elemen. 820,. In conjunction with eh pcecej* , cor* 

. to 9 ene,a!e ^^^^^^^^^ m*. ptoduced by ou. t^enton * conriolteC 
As one can now appreciate ^auainy _ci ine !ie*u i _y rly classify imag€ pixels located in the vicinity 

^evaluesd^ 

ot edges in an .mage. A relatively low err va w iienas , icm e w k vahje tends ^ ^ 

classify pixels located in 

, 5 pi , els ol a ^JJ "^^1^ IT. In this situation, the va.ue d - IhreshoW GT 

purposes performs similar to s mp e g lo classHy pixels by essentially solely com- 

Wi " * W rJ SEZS SS^SLoM IT B Our invention can also p-oduce an ^ine ir^ge thrpugh 

Sno SfSX *£wd IT to z ero. in which case all the image pixels will be defied as whrte except for the edge 

ot^S eS^ that incorporate the teachings of the invention may be easily constructed by those sM.ed « 
the art 

r » ISIRIAI APPL1CAFH TV AND ADVANTAGES 
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eliminating boundary artHacts from a threshoWed image. 



Claims 
1. 



55 



JS^p^Sh^.^SpSS^^ P..I value associated M d-«-*- m that m. 
contained within •*^^/^^3Ln value M „e ™,imum and minimum pixel values, a eunent one ol 

ss^srssrsrss?*; * - *- » »n «*», ^ « . -.^^ 

position in the f irst output image. 

^'"lormfng the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, determining said area gradient value. 

tk me thnd in claim 2 wherein said first window forming and area gradient determining step comprises the step of 
lZ™^SoJo< ^ intensity gradient values in sakl first window to produce the area gradient value. 
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4 The method in claim 3 wherein said thresholding step comprises the steps Of: 

comparing the area gradient value. GS(i j). to a pre-defined gradient threshold value. GT. so as to produce 
a comparison signal indicative of whether a cunent one input pixel located at the current pixel position fi j) m the 
input image lies in a vicinity of an edge in said input image; u . ^ « 

H the comparison signal indicates that said current one input pixel does not Be m the vicinity ol the edge, 
thresholding in response to said comparison signal, said input pixel value at position (i j) in the input image against 
a pre-defined fixed gray-scale threshold value. IT. to yield a coriesponding binary output value at pixel position (i j) 

in the f irst output image; and „ . . 

H the comparison signal indicates that said one current input pixel does lie within the vicinity of an edge, 
setting in response to said comparison signal, said corresponding binary output value to a first or. second state If 
the current one pixel value either exceeds or is less than an average of the maximum and minimum pixel values, 
respectively. 

5 The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step of producing the 
' intensity gradient value tor the current pixel position by processing said third window of input pixel values through 

a Sobel operator. 

6. The method in claim 5 wherein the third window is a 3-by-3 window of input pixel values end the Sobel operator 
implements the following equations: 

GXfij)«Lf»1j-1) + 2MHlj) + Lfi+1j+1)^ 

GYflj) = L(i-1 + 2Mij+1) + j+1) • MM - 2Mg-1) - Lfl+lj-1); 

and 

G(ij) = |GXfij)|4|GY(ij)| 

where: L(ij) is an input pixel value, in luminance, for 
the pixel position (ij) in the input image. 

7 The method in claim 4 further comprising the steps of: 

producing, in response to said comparison signal and the pixel value (Lc) at the cunent pixel position (ij), a 
modified gray-scale output pixel value at position (ij) in a second output image, wherein, if the comparison signal 
indicates that the one cunent input pixel does not lie in the vicinity of the edge in said input image, the modified 
orav-scale output pixel value is set equal to the pixel value Lc. or H the comparison signal indicates that the cunent 
one input pixel does lie in the vicinity of the edge, the modified gray-scale output P»*el value is set equal to a pre- 
defined value greater than or less than the threshold value IT when the pixel value Lc is greater or less than, respec- 
tively, the threshold value IT; and , 

thresholding the modified gray-scale output pixel value, against the threshold value IT. to yield a corresponding 
second binary output P i3<el va,ue 31 a P ixel P° si f' on OJ) within a second output image. 

8 ADDaratus for thresholding an input gray-scale image into a first output image, wherein said input image is tormed 
' ofinpul pixels each having a multi-bit gray-scale pixel value associated therewith, and wherein said first output image 

is formed of pixels each having a corresponding output pixel value associated therewith, characterized in that the 
apparatus utilires the steps recited in any of claims 1-7. 
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